Skip to content

Add Central and Eastern European PII language packs#1767

Merged
maziyarpanahi merged 1 commit into
masterfrom
feature/om-194-cee-pii-language-packs
Jul 24, 2026
Merged

Add Central and Eastern European PII language packs#1767
maziyarpanahi merged 1 commit into
masterfrom
feature/om-194-cee-pii-language-packs

Conversation

@maziyarpanahi

Copy link
Copy Markdown
Owner

Description

Adds Ukrainian, Czech, and Greek as fully supported PII language packs. Ukrainian receives a Cyrillic-native detector pack and weighted-checksum RNOKPP support; the existing Czech and Greek packs are promoted from identifier-only coverage to the multilingual privacy-filter family.

Type of Change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Documentation update
  • Code refactoring
  • Performance improvement
  • Test addition/improvement

Changes Made

  • Add Ukrainian date, phone, RNOKPP, address, and postcode patterns with exact-offset golden coverage.
  • Wire Ukrainian, Czech, and Greek through supported-language constants, script routing, locale-aware deterministic ID providers, service/client enums, OpenAPI, and model-manifest aliases.
  • Add locale fake data, synthetic training templates, month names, round-trip regression tests, and synchronized public language documentation.

Testing

  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally with my changes
  • I have tested this change with different models/inputs

Validation completed:

  • .venv/bin/python -m pytest tests/ -q — 5,222 passed, 55 skipped
  • make format
  • make lint
  • make format-check
  • make docs-build
  • uv build
  • scoped pre-commit checks for every changed file

Documentation

  • I have updated the documentation accordingly
  • I have added docstrings to new functions/classes
  • I have updated the CHANGELOG.md

Code Quality

  • I ran make format, make lint, and make format-check
  • For Swift/OpenMedKit changes, I ran make format-swift and make lint-swift
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • My changes generate no new warnings

Dependencies

  • I have not added any new dependencies
  • OR I have added new dependencies and they are justified because: ____

Checklist

  • I have read the contributing guidelines
  • My commits have clear, descriptive messages
  • I have squashed/organized my commits appropriately

Related Issues

Closes #1462

Screenshots/Examples

Not applicable; this change affects library, service-contract, fixture, and documentation surfaces.

@maziyarpanahi maziyarpanahi added feature New capability P3 Strategic roadmap-v2 OpenMed V2 roadmap backlog labels Jul 19, 2026
@maziyarpanahi
maziyarpanahi force-pushed the feature/om-194-cee-pii-language-packs branch from b862b69 to a965ba0 Compare July 24, 2026 10:45
@maziyarpanahi
maziyarpanahi marked this pull request as ready for review July 24, 2026 10:45
@maziyarpanahi

Copy link
Copy Markdown
Owner Author

Rebased onto the latest master and resolved the language-pack catalog, PII locale, generated manifest, tool-schema, TypeScript parity, and documentation conflicts against the current centralized registry. I also refreshed the committed adapter snapshot and kept the model manifest deduplicated and schema-current.

Validation is green:

  • full suite: 7733 passed, 52 skipped
  • language-pack coherence suite: 1293 passed
  • Ruff lint and format checks
  • PR-scoped pre-commit hooks
  • strict documentation build and README translation drift check
  • full hosted CI matrix, package/container builds, security, provenance, benchmark, and smoke gates

The rebased commit is signed, uses the repository-owner identity, and has no co-author trailer. This is ready to merge.

@maziyarpanahi
maziyarpanahi merged commit 0189805 into master Jul 24, 2026
26 checks passed
@maziyarpanahi
maziyarpanahi deleted the feature/om-194-cee-pii-language-packs branch July 24, 2026 11:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feature New capability P3 Strategic roadmap-v2 OpenMed V2 roadmap backlog

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add Central/Eastern European PII language packs (Ukrainian, Polish-adjacent Czech, Greek)

1 participant